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Abstract:In this paper, we abstract a kind of stochastic processes from evolving processes of 
growing networks, this process is called growing network Markov chains. Thus the existence 
and the formulas of degree distribution are transformed to the corresponding problems of 
growing network Markov chains. First we investigate the growing network Markov chains, 
and obtain the condition in which the steady degree distribution exists and get its exact 
formulas. Then we apply it to various growing networks. With this method, we get a 
rigorous, exact and unified solution of the steady degree distribution for growing networks. 
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1 Introduction 



Barabasi and Albert^found that for many real-world networks, e.g., the World Wide Web 
(WWW), the fraction of vertices with degree k is proportional over a large range to a power- 
law tail, i.e. P(k) ~ fc~ 7 , where 7 is a constant independent of the size of the network. 
For purpose of opening up mechanism producing scale-free property, they proposed the 
well known BA model and summarized the reasons: growth and preferential attachment. 
The proposing of BA model led to a great echo among people, with hundreds of advanced 
network models proposed and studied, it also gave rise to a new upsurge in studying complex 
networks. Some important examples are as follows: 

* Supported by National Natural Science Foundation of China (No. 10671212). 
^Email: zthou@csu.edu.cn 



1 



Ex 1.1 (BA model- ) Barabdsi and Albert et al. proposed a model which starts with a small 
number (mo) of vertices, at each time step add a new vertex with m (< m ) edges that link the 
new vertex to m different vertices already present in the system. To incorporate preferential 
attachment, they assumed the probability IT that the new vertex will be connected to a vertex 
i depends on the connectivity k{ of vertex i, that is H(ki) = mkj / kj. After t steps the 
model leads to a random network with t + itlq vertices and mt edges. Let ki(t) denotes the 
degree of vertex i at time t, from the mechanism of the model we know that ki(t) is a Markov 
chain. 

Ex 1.2 (Growing network with random links) Each vertex is chosen randomly in this case, 
that is, Hi = 1/t, everything else remains the same as BA model. 

Ex 1.3 (LL model(i)l2]) The model is proposed like this: at each time step a new node 
with m links (edges) is added, and the probability Hi is determined by m Yy\(i-p)k P +p} > w ^ ere 
< p < 1 is a parameter characterizing the relative weights between the deterministic and 
random contributions to Hi, and the summation is over the whole network at a given time. 
The model reduces to the BA model for p = and it becomes a completely random network 
for p = 1 . So far the evolving mechanism of the LL model has not found, so we introduce 
the following example in which the boundary between preferential and random are clear. 

Ex 1.4 (LL model(ii)) Everything else remains the same as the former example except that 

■pr _ m(l-p) j _| mp 
1 2mt+N ' t+m ' 

Ex 1.5 (Generalized collaboration networks^) Zhang P.P., et al. supposed the initial net- 
work to be several complete graphs with m vertices, the sum of degree k i0 is k . At each 
time step add a new vertex to the network and connect it to T — 1 (T is a constant) different 
vertices already present in the system. The probability that vertex i get a link is proportional 
to the degree of the vertex, i.e. Hi = After this, link all the T vertices to form a 

complete graph. 

Ex 1.6 (ZRZ model^) The initial network (t = 0) is a complete graph (m-complete graph) 
with m vertices and edges. At each time step a new vertex is added to the network, it 
will connect to all the vertices of a m— complete graph selected randomly, that is m + 1 people 
are collaborated in an act. 

Ex 1.7 (KK model^) At the beginning (t = 1) we have one group with one element in it. 
At each time step we add a new element to the system. With probability p it will belong to 
one of existing groups. The probability that it joins the ith group is proportional to the size of 
the group (ki/N) (the number of elements is equal to the time i.e. N = t). With probability 
q = 1 — p, the new element will belong to a new group. 
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Ex 1.8 (DMS modeP) At each time step a new site appears. Simultaneously, m new di- 
rected links coming out from non-specified sites are introduced. Let the connectivity q s be the 
number of incoming links to a site s, i.e., to a site added at time s. The probability that a 
new link points to a given site s is proportional to the following characteristic of the site: 
H s = H + q s , thereafter called its attractiveness. All sites are born with some initial attrac- 
tiveness H > 0, but afterwards it increases because of the q s term. Note that one may allow 
multiple links, i.e., the connectivity of a given site may increase simultaneously by more than 
one. 

Ex 1.9 (LCD model^) Based on BA model, Bollobds et al. proposed another model which 
allows multiple links and loops. 

Except LCD model, the existence and deduction of degree distribution of the present models 
(including the noted BA model) are devoid of exact mathematics basis. Recently, a mecha- 
nism for BA model is given in [8] and [9] . Moreover the existence and exact formulas of the 
degree distribution were also provided. In this paper we abstract a kind of Markov chains 
from enumerated models, we call it as growing network Markov chains. First we investigate 
the growing network Markov chains, and obtain the condition in which the steady degree 
distribution exists and get its exact formulas. Then we apply it to various growing net- 
works. With this method, we get a rigorous, exact and unified solution of the steady degree 
distribution for growing networks. 



2 Non- multiple Growing Network Markov Chains 

For any i = 1, 2, ■ • ■ , ki(t)(t — i, i + 1, • • •) are Markov chains non-decrease with respect to t 
taking values in {0, 1,2, • • •}. Suppose there exists a positive integer i , s.t, {ki(t)}(i > i Q ) 
have the initial distribution P{ki(i) = k} = dk,i, with transition probability 

r / 4 (ao, z = * + i, 

P{k l (t+l) = l\k l (t) = k} = I l-f t (k), l = k, (2.1) 

[ 0, otherwise. 

t 

where < f t (k) < 1. Let P{k,i,t) := P{h(t) = k}(t = + ■ ■ ■), P(k,t) := \^2P(k,i,t). 

i=l 

Definition 2.1 The above Markov chains {ki{t)} t =i,i+i, -{i — 1>2, •••) are called series of 
non-multiple growing network Markov chains, for short we call it non-multiple growing net- 
work Markov chains, if the limit P{k) = lim P(k,t) exists, and 

t— »oo 

oo 

P(*)>0,]£P(*) = 1. (2.2) 

k=0 
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we say that the degree distribution of non-multiple growing network Markov chains exists, 
and P(k) is the steady degree distribution of {ki(t)}. Further, if P(k) is power-law, i.e., 

P{k) ~ k-~<{k > ko), (2.3) 

{ki(t)} are called scale-free non-multiple growing network Markov chains. 

oo 

Lemma 2.2 // lim d^i = d k exists and satisfies d k = 1. lim tf t (k) := F(k) also exists, 

i — >oo k=0 ^ — 

and there is a non-negative integer m to satisfy dk = 0,k = 0, 1, • • • , m — 1, d m > 0, and 
F(k) > 0(k — m, m + 1, • • •). Then lim P(m, t) exists, moreover 

t— *oo 

P ( m ) = ^_ (2.4) 

v ; 1 + F(m) V ; 

Proof With the Markovian property, we have 

P(m,i,t + l) = P(m,i,t)[l-f t (m)], (i<t). (2.5) 

By the definition of P(m, t) and P(m, t + \,t + \) = d m ,t+i, we obtain 

P(m,t + 1) = j^P(m,t)[l - f t {m)\ + ^y<W- (2.6) 
The above difference equation has the following solution 



t-i ( t-i i } 

P(m, t) = - Jill - fi(m)\ \ P(m, 1) + £ d m , l+1 J][l - f 3 (m)]" 1 \ . (2.7) 



Let 



i=i k i=i j=i 

t-i i 
x t = P(m, l) + £ rf m , i+1 JJl " /jH]" 1 . 

t-i 

%=*n[ i_ ^ m )]" 1 >*->oo. 
i=i 



We easily have 



xt+i -x t = d m:t+1 - fj(m)] \ 

3=1 

t 

y t+1 -y t = [l + tf t (m)} JJl - /iH]" 1 > 0. 



j'=i 
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With lim tf t (m) = F(m), we have 

t— >oo 



%t+l ~~ x t ^m,t+l d m 



(t->oo). {21 



yt+i-yt l + tf t (m) 1 + F(m) 

With the Stolz-Cesaro theorem we have Eq (12. 4p and complete the proof. 

Lemma 2.3 If the conditions in Lemma W^ are all satisfied, and for k > m, lim P(k — l,t) 
exists, then lim P(k, t) exists, moreover 



t^oo 



t— »oo 



p w = ^ p fi-» + rrh>- (2 ' 9) 

Proof With the Markovian property, we have 

P(k, i,t+l) = P(k, i, t) [1 - f t (k)) + P(k - 1, i, t)f t (k - 1) + d k>t+1 . (2.10) 

The definition of P(k, t) and P(k, t + 1, t + 1) = d k ^ +1 yield 

P(k,t + 1) = ^Pfatyl - f t (k)] + ^Pik - l,f)/ t (* - 1) + (2.11) 

The above difference equation has the following solution 



P{k,t) = ±f[[l-Mk)) 



t 

8=1 

t-1 I 

{P(k, 1) + J2 [lP(k - 1> 0/»(* - 1) + 4,m] U 1 - /jW]" 1 }- ( 2 - 12 ) 
z=i j=i 

Similar to Lemma [2.21 we have Eq (12.9[) . then complete the proof. 

Theorem 2.4 If the conditions in Lemma WJ^ are all satisfied, the steady degree distribution 
of {ki(t)} exists, moreover 

{ dm U — <YTt 

1+F(m)' K ~ " t ' 

tt 1 m r d m y^ 1 T^k 1 fc>m (2.13) 
%-m l-m 11 1+F( . +1) 

ProofFrom Lemma [2.21 and Lemma [2. 3 [ Eq (12.131) comes into existence. 



Theorem 2.5 Suppose there is a non-negative integer M > m and satisfies dk = 0(k > M). 
And if there two constants A, B, satisfy F(k) = Ak + B, then 

(I) The degree distribution P(k) satisfies 

oo 

£p(*) = l. (2.14) 

k=m 

(II) If A > 0, then {fcj(i)} are Scale-free growing network Markov chains, and 

dm U try) 

1+Am+B> ^ ~ " t ' 

k—1 k—1 ^z+i 

tt Ai+B r d m , i+A(i+i)+a i m <T k < M 

11 1 + A(i+1)+Bh+Am+B + I A . +B J' — ' 



P{k) 



' l=m n 1+ A( j+ i)+B 



r(k+4) r(M+|+i+i) V r v (2.15) 



r(*+f +1+4^) r(M+f) l+A(i+l)+BLl+Am+B 
M-l d i+i 

+ V 1 ~ A;-( 1+ i), k > M. 

l- m n A J+ B 



Specially, if d m — 1, c? fc = 0(/c 7^ to), i/ien 



P(/c) = r( A: + #) r (m+ f + i + ^) 1 , (2.16) 

[ r(fc+f r(m+f ) l+im+B A , K>m. 

(III) If A = 0, B > 0, {ki(t)} are scale-free growing network Markov chains. 

(IV) The case for A < or A = 0, 5 < will never happen. 

Proof From Eq fl2.4|) . (12. 9p and the given condition, we easily obtain Eq fl2.14|) . (II), (III) and 
(IV) are also easily proved. 

Let fcj(i) denote the degree of the vertex added at time-step i evolved at time t in the former 
examples, and {ki(t)} are growing network Markov chains. Therefore we can apply Theorem 
12.41 and Theorem 12.51 to the former examples. 



k 



Example 1.1 We have d m = 1 and f t (k) = 4J^, so A = f , B = 

k = to. 



P(k) = { m M) r(m+3) 2 o 2? -3 ; ^ ( 2 -17) 

1 r(fc+3) r(m) m+2 ~ 2 ™ * > fc > ™" 

the network is scale-free with scaling exponent 7 = 3. This is identical with the results in 
[lj|6j[llj[8j[9j. A different and exact proof of degree distribution and an evolving mechanism 
of this model have been provided in papers j8] and [9] . 
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Example 1.2 From the model we have d m — 1 and ft{k) = ™, so A = 0, B = m. The 
steady degree distribution exists, and 



\ k—m , 

m / m \ 1 



P(jfc) = P(Jfe-l) = . (2.18) 

v ; 1 + m v ; \l + m/ 1 + m V ; 

is exponentially distributed, the network is not scale-free. 

Example 1.3 d m = 1 and f t (k) = m ^-^E_ fc + m (1 _ p)2 P mW A = m (1 _^ +p , P = 
m (i- P )2m+p - ^ P 7^ 1) the degree distribution 

2m+(l-2m)p k = 171 

m, 2 +2m+(l— m. 2 — m)p ' ' 
p(U\ = J r ( fc +T^) r(m +T ^+3+^) 2m+(l-2m)p / 91q x 

rl '' j \ r(fc +T i^+3+^^^) r(m +T ^) m 2+2 m +(l- m 2_ m)p 

~ &~( 3+ ™(i-p)) ; k > m. 

is power-law with scaling exponent 7 = 3+ m ^_ p ^ ■ P(k) follows exponential distribution if 
/' I • 

Example 1.4 We have d m = l,f t (k) = m^^-k + = ^,B = mp. 

, x j 2+m+mp' k = m, 

P(k) = \ r( fc+ £g) r (m+ ^ + i +I ^) 2 (2.20) 

[ r(fc+f=£+l +T ^) r(m+^|) 2+m+mp» ft ^ 

If p — 1, P(fc) is not power-law, and if p ^ 1 

~ AT (1+ ^ } (2.21) 
is power-law with the scaling exponent 7 = 1 + y^. 

Example 1.5 We get di = l,/t(fc) = ^~+rt , so A = -^-,B = 0. So the network is 
scale-free and the degree distribution is 

P(k) ~ fc- (1+ ^T } . (2.22) 

and scaling exponent is 7 = 1 + 

Example 1.6 d m = l(m > 2), / t (fc) = ^g* - so A=^,B = -m(m - 2). 
The network is scale-free and the degree distribution is 

P(k) ~ fc- (1+ ^r\ (2.23) 

with scaling exponent 7 = 1 + 
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Example 1.7 do — p, d± — 1 — p, /t(&) = pf , so A = p, _B = 0, in this model ki(t) denotes 
the number of elements in group added at time-step i evolved at time t. 

The degree distribution is 

( P: k = 0, 

P(k) = I hi ' k = X > (2.24) 

I r(fc)r ( 2+i) !_ p 

I r(fc+i+±) i+p' 
so it's power- law and the scaling exponent is 7 = 1 + K 



3 Multiple Growing Network Markov Chains 

The degree of a vertex can increase at most 1 in network of non-multiple links. However, 
the degree can increase more than 1 if multiple links is permitted. We have found that the 
probability of vertex's degree increase more than 1 is the high-level of infinitesimal. For 
the purpose of investigating the degree distribution of multiple linking growing network, we 
introduce multiple growing network Markov chains. 

For any % = 1, 2, • • • , hi(t)(t — i, % + 1, • • •) are Markov chains non-decrease with respect to 
t taking values in {0, 1, 2, • • •}, suppose there exists a positive integer i , s.t, {ki(t)}(i > i ) 
have the initial distribution P{ki{i) = k} = dk,i, with transient probability matrix 



/ Po,o Po,i 00,2(7) ••• O0,m'(?) 

Pl,l Pl,2 01,3(7) Ol,m'+l(j) 



Pk,k Pk,k+i o k ^ k+2 (\) ■■■ o KjK+m >(\) 
1 



V 



(3.1) 



/ 



where pk 1 = P{ki(t + 1) = l\ki(t) = k}. For k < K{K is the maximum degree of vertex i at 





Pk,l 



l-/t(*)-ESh2 0*,.(7). l = ^ 

ft(k), l = k + l, 

o M (|), k + l<l<k + m', 

0, else. 



(3.2) 



and for k > K 



Pk,i 



1, l = k, 
0, l^k + 1. 



(3.3) 
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Definition 3.1 The above Markov chains {ki{t)}t=i,i+i,---{i = 1>2, •••) are called series of 
multiple growing network Markov chains, for short we call it multiple growing network 
Markov chains , if the limit P(k) = lim P(k,t) exists, and 



P(k)>0,J2 p (k) = h (3-4) 

fc=0 

we say that degree distribution of multiple growing network Markov chains exists, and P{k) 
is the steady degree distribution of {ki(t)}. Further, if P{k) is power-law, i.e., 

P{k) ~ k~\k > ho), (3.5) 

{ki(t)} are called scale-free multiple growing network Markov chains. 

oo 

Lemma 3.2 If lim c4,« = <4 exists and satisfies ^ — 1. lim tf t (k) := F(k) also exist, 

i — >oo k=0 ^ — 

and there is a non-negative integer m to satisfy c4 = 0, k = 0, 1, • • • , m — 1, d m > 0, and 
F{k) > 0(k = m, m + 1, • ■ ■). Then lim P(m,t) exists, moreover 

t— >oo 

P ( m ) = ^— . (3.6) 

Proof With the Markovian property, we have 

P(m,i,t + 1) = P(m,i,t)p m>m , (i<t). (3.7) 

By the definition of P(m, t) and P(m, t + 1, t + 1) = rf m ,t+i ; we have the following equation 

m+m' 

-P(m.tM\ - Urn) - 

t + 



^ m+m' ^ ^ 

P(m,t + 1) = _p( m ,t)[l-/ t ( m )_ ^ 0ms (_)] + __ rfmim . (3.8) 



=m+2 

the above difference equation has the following solution 

t— 1 m+m' 



i=l s=m+2 

t— 1 u m+m' ^ . 

P(m,l) + ^d m , t ^ 1 IJ[l-/ i (m)- E ^*(-)]~ 1 r- ( 3 ' 9 ) 



u=l j'=l s=m+2 

Similar to Lemma [2.21 we have Eq (13. 6p . 
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Lemma 3.3 If the conditions in Lemma \3.2\ are all satisfied, and lim P(k — l,t) exists, then 
lim P(k,t) exists, moreover 



t— >oo 



t^oo 



P tk) = F{k il p(Jfc - 1) + d * , (3.10) 
Proof With the property of the Markov chains, we have 

m' 

i, t + 1) = i, t)p M + P(k - 1, z, t)p fc _i, fe + ^ P(£; - /, z, (3.11) 

1=2 

By the definition of P(k, t) and P(fc, t + 1, i + 1) = c4,m> we have the following relation 

k+m' 



P(k,t + i) = ^P(M)[i-/ t (fc)- E ^())] + ^(*-M)/*(fc-i) 

s=fc+2 

m t 11 

+ ^^- I ^-^i)o^(^) + ^- I 4,m- (3.12) 

1=2 



Solve the above difference equation we have 

t-l k+m' .. t-1 



p(&, = 7 IJ 1 - /<(*) - E OkA])}{P(k, i) + J>p(* - 1, u)f u {k - 1) 

i=l s=k+2 u=l 

ml 1 w k+m' 1 

+ ^ u p(fc-i )U ) 0fc _ Ijfc (_) + d M+1 ]JJ[i_/ J .(A;)- g Ofc,^-)]- 1 }. (3.13) 



U "~ * — ' 7 

Z=2 J=l s=fc+2 J 



Similar to Lemma 12.21 we have 
P(k) = limP(M) 



t— >oo 

r tP(k - 1, t)/ f (fc - 1) + ggg tP(fc - 1, t)0 k ^ k {\) + 4, f+ l 

4 ™ (t + i)-t[i-/iW-ES^(i)l 

lim * P ( fc -M)/t(fc-l) + 4,t+i 

i + */ t (A0+*£S£ 2 °* 



+ lim 



=fc+2 "MVt- 

E£ 2 tP(fc-/,t)o fc _^.(i) 

k+m' I \ \ 



t 



^i+tm+tz^ok 

F{k - 1) P(k-l)+ (3.14) 



then complete the proof. 
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Theorem 3.4 // the conditions in Lemma \3. 2\ are all satisfied, then the steady degree dis- 
tribution of {ki(t)} exists. Moreover, 



P{k) 



1+F(m) ' 

j-r F{%) 



m, 



1+F(i+1) ll+F(m) 



+ E- 

l=m 



a l+i 
1+F(i+1) 



I 

n 



T+fU+T) 



k 

k > m 



(3.15) 



ProofFrom Lemma [3.21 and Lemma [3. 3 [ Eq (13.151) comes into existence. 



Theorem 3.5 Theorem \2.5\ is also held when allowing multiple linking and loops. 

Theorem 3.6 If f t (k) = a t k + b t + o&(t), we have lim tf t (k) := F(k) =Ak + B if and only 
if lim ta t = A, lim tb t = B. 

t— >oo t— >oo 



Example 1.8 From the DMS model we get: d = 1, f t (k) = m j^§y t , so A = ^jj,B 
^xtt, with Theorem 13.41 and Theorem I3.5[ we have 



m+H 

m r(k-?+H) r(H+ 2 +f) m+H . , ( 2 +f) t>n ( 3 - 16 ) 
r(fc+i+H+f ) r(i?) m+i+ m ]f K •»,«;> u. 

So the network is scale-free and degree exponent is 2 + — . 



Example 1.9 From the model we get d m = 1, ft(k) = m 2m t +rn ; so A = ^, B = 0, with 
Theorem 13.41 and Theorem 13.51 we have 

{771-1-2 ' ^ == 

"r(fc) T(m+3) 2 o 2; -3 7 ^ (3-17) 

r ( fc+3) ~ 2m fc > fc > m - 

it is the same as in [7]. 
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